Skip to content

Update Japan data fetcher#77

Merged
kratzert merged 8 commits intomainfrom
japan
Nov 6, 2025
Merged

Update Japan data fetcher#77
kratzert merged 8 commits intomainfrom
japan

Conversation

@kratzert
Copy link
Owner

@kratzert kratzert commented Nov 6, 2025

Data is now retrieved from the underlying .dat files, instead of displayed html tables. This makes the data processing much nicer, since the .dat files contain a csv-like structured data.

I was able to figure out how to support hourly/daily for stage and discharge. Metadownload is tricky, since everything is in Japanese. In theory I know how to get the data, but river and locations and everything is in Japanese characters. Also, the only way I figured out so far is querying metadata station by station.

@kratzert kratzert merged commit 4b8cf85 into main Nov 6, 2025
6 checks passed
thiagovmdon pushed a commit that referenced this pull request Nov 9, 2025
* WIP commit

* Working timeseries retrival

* Updated tests

* Update Japan fetcher

* Removing metadata download option

* Formatting

* Fix missing data flags
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant